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AN e-NASH EQUILIBRIUM WITH HIGH PROBABILITY FOR STRATEGIC 
CUSTOMERS IN HEAVY TRAFFIC 

RAMI ATAR AND SUBHAMAY SAHA 


ABSTRACT. A multiclass queue with many servers is considered, where customers make a join- 
or-leave decision upon arrival based on queue length information, without knowing the scheduling 
policy or the state of other queues. A game theoretic formulation is proposed and analyzed, that takes 
advantage of a phenomenon unique to heavy traffic regimes, namely Reiman’s snaphshot principle, 
by which waiting times are predicted with high precision by the information available upon arrival. 
The payoff considered is given as a random variable, which depends on the customer’s decision, 
accounting for waiting time in the queue and penalty for leaving. The notion of an equilibrium is 
only meaningful in an asymptotic framework, which is taken here to be the Halfin-Whitt heavy traffic 
regime. The main result is the identification of an e-Nash equilibrium with probability approaching 1. 
On way to proving this result, new diffusion limit results for systems with finite buffers are obtained. 
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1. Introduction 

Equilibrium behavior of strategic customers in queueing systems has been the subject of great 
interest since the work of Naor iflZl (see the book by Hassin and Haviv 0 for a survey), and has 
been a particularly active research area in recent years. As far as heavy traffic analysis is concerned, 
not a great deal of attention has been drawn to game theoretic aspects such as the asymptotic study 
of Nash equilibria, unlike, for example, control theoretic treatment, to which much work has been 
devoted. In this paper we propose and analyze a game theoretic formulation of strategic customers in 
a multi-class queueing system, that takes advantage of phenomena specific to heavy traffic regimes. 
The formulation is based on associating with each customer a payoff that reflects the customer’s 
actual waiting time rather than its expectation. The notion of equilibrium addressed, namely an 
e-Nash equilibrium with high probability (w.h.p.), becomes meaningful only as scaling limits are 
taken. An additional aspect that is unique to this setting regards the relatively small level of infor¬ 
mation required for the players. In game theoretic analysis of queueing models, it is usually the 
case that when partial information of the system's state is available to the player, the unobservable 
states are assumed to be in stationarity. In the setting of this paper, customers are aware of the queue 
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length of their own class but not those of other classes, and moreover, the scheduling policy is not 
known to them. However, stationarity assumptions are not required. 

The model considered consists of a fixed number of customer classes, that differ in their service 
rates, and n identical, exponential servers that work in parallel. Upon arrival of a class-/ customer, 
the ith queue length is revealed and, based on this information, he decides whether to join or leave. 
Accordingly, the customer’s payoff is given by hfWT ) or r,, respectively, where hi : M + —> M + is 
a given function, WT is the time the particular customer will wait in line before being admitted 
into service, and r, £ (0,°°) is a cost for not receiving service (both /;,■ and r,- depend on the class, 
/). Because WT is a random variable the value of which is not known at the time of decision, the 
payoff is in fact a random function of the customer’s decision, as well as other customers’ decisions. 
Establishing an equilibrium based on random payoffs is made possible thanks to the consideration 
of the game in an asymptotic regime. 

The asymptotic setting considered is the Halfin-Whitt (HW) heavy traffic regime HO, in which 
the number of servers, n, grows without bound, and the arrival processes accelerate accordingly so 
as to keep the system critically loaded. The customers considered are those that arrive during a 
fixed, finite time interval. Thus the number of participating players also grows without bound. 

The specific feature due to which a random payoff formulation is tractable in this regime (and 
potentially in other heavy traffic regimes) is Reiman’s snapshot principle (RSP) fl3ll . which, when 
specialized to the present setting, states that the waiting time a customer will experience is asymptot¬ 
ically equal to the queue length at the time of arrival divided by the overall rate at which customers 
from the class are served (see Section [5] for a precise statement). While this principle has been 
proved in a number of settings, it does not always hold (as explained in R c m ark |2.2| he I o w). In par¬ 
ticular, its validity depends on the scheduling policy. Our equilibrium results, that are based on this 
principle, can therefore only be obtained under some assumptions on the scheduling. We address 
this aspect by considering two families of scheduling policies under which, as we show, RSP holds: 
fixed priority (FP), where a server that becomes available will always pick the customer at the head 
of the line of the buffer with least index among non-empty buffers, and serve the longest queue 
(SLQ), where the buffer with longest queue is picked. Our main result shows that if all customers 
adopt a strategy that uses RSP as a prediction for the waiting time, an £-Nash equilibrium w.h.p. is 
obtained. 

On way to proving the main result we prove new diffusion limit results for the above two poli¬ 
cies, for systems in which customers join only when the queue length of the corresponding buffer is 
below a threshold, an element that can otherwise be described by finite buffers. A non-standard as¬ 
pect of the diffusion scale analysis required toward proving the main result is that one must take into 
account different behaviors of customers, so as to allow for scenarios where one of the customers 
deviates from the strategy that is to be shown to lead to an equilibrium. In particular, properties on 
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which the proof is based, such as the C-tightness of some of the processes involved, are proved to 
hold uniformly over such scenarios. 

The only work the authors are aware of where a game theoretic equilibrium is considered in 
conjunction with heavy traffic analysis of a queueing model is by Gopalakrishnan et al. US, that 
studies servers that act strategically. Specifically, they choose their service rate in order to optimize 
a tradeoff between an effort cost and value of idleness. The focus of @ is on the study of the 
implications of such strategic behavior on staffing and routing, as the size of the system becomes 
large. The notion of equilibrium is not of the type considered here, but is based on deterministic, 
steady state payoffs, as well as on complete state information. Moreover, the asymptotic analysis is 
provided subsequently to establishing the prelimit equilibrium. 

As far as our convergence results and RSP are concerned, the closest work is by Gurvich and 
Whitt 0, where a parallel server system, with multiple classes as well as multiple server pools, 
is considered in the HW regime, under the fixed queue and idleness ratio policy. This policy aims 
at keeping queue lengths as well as idleness levels at the different server pools at predetermined 
fixed ratios. When specialized to the case of a single server pool, and equal queue length ratios, this 
setting is similar to one of the two settings studied in this paper, namely SLQ. There are, however, 
two important differences in terms of the technical treatment. First, as already mentioned, the 
estimates required to deduce the main result must be uniform over scenarios. A second difference is 
that finite buffers are not covered by 0. Although it may seem that this aspect requires only simple 
adaptations to cover convergence results, this is not the case. In fact, diffusion limits do not always 
exist under our assumptions, as is the case under SLQ if the buffers are of equal size (this issue 
is developed further in 0). Hence considerations beyond the infinite buffer model are necessarily 
significant here. 

As an additional small sample of recent work on strategic behavior in queueing systems, we 
mention Guo and Hassin 0, that analyze the response of customers to shutting down service when 
the queue is empty, and resuming when the queue length exceeds a threshold; and Manou et al. ifTITl . 
that studies a natural model for the behavior of customers in a transportation station. In both cases, 
Nash equilibria are determined under various assumptions on the level of information. 

We use the following notation. For a.b 6 M, the maximum [resp., minimum] is denoted by a V b 
[resp., a/\b], and a + = a VO, a~ = (—a ) V 0. For x,y € M A ( k a positive integer), x-y and ||jt|| denote 
the usual scalar product and 1 2 norm, respectively. Write {e,}, i = 1,... ,k for the standard basis 
in R k and 1 for £ A =1 e,-. Denote R + = [0,°°). For / : M + —> M. k , ||/||r = sup f€ j 0 r j ||/(?)||, and, for 

e > 0 , 

W T {f,0)= sup ||/« —/ill- 

0 <s<u<s+e<T 
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For a Polish space 5?, let Cy([0, T]) and By(\0.T}) denote the set of continuous and, respectively, 
cadlag functions [0, T] —» 5? . Write Cy and B y for the case where [0, T] is replaced by R + . Endow 
By with the Skorohod J\ topology. Write X n => X for convergence in distribution. A sequence of 
processes X n with sample paths in By is said to be C-tight if it is tight and every subsequential limit 
has, with probability 1, sample paths in C y. For a sequence of processes q", n £ N, with sample 
paths in B R t, C-tightness is characterized (see VI.3.26 of flOl ) by 

Cl. The sequence of random variables ]|4"||:r is tight for every fixed T < °o, and 

C2. For every T < °o, e > 0 and f] > 0 there exist no and 6 > 0 such that 

n > no implies P(w 7 ’(^' i , 0) > q) < e. 

For a positive integer k , m £ M /( and a symmetric, positive matrix A G M. kxk , an (m. A )-Brownian 
motion (BM) is a ^-dimensional BM starting from zero, having drift m and infinitesimal covariance 
matrix A. 

This paper is organized as follows. The model and the equilibrium result appear in Section 
|2] Section [3] and |4] analyze the behavior of the system under FP and SFQ, respectively, and along 
the way also obtain diffusion limit results, that may be interesting by their own right. Section [5] 
addresses RSP in these two settings, and proves the main result. 

2. Model and Main Result 

We start by introducing the probabilistic model and the F1W scaling. Then we provide the game 
theoretic setting, and state the main result. 

A sequence of queueing models is considered, indexed by n £ N. The nth system has N buffers 
and n identical servers. Customers from N distinct classes arrive at the system and, upon arrival, 
each customer is informed about the queue length at the buffer that corresponds to its own customer 
class, and, based on this information only, makes a decision whether to join or leave the system. If 
a customer of class i decides to join, he goes directly for service on the event that any of the servers 
is available, and otherwise he is queued in buffer i. As far as the service policy is concerned, we 
consider FP and SFQ (that is, however, unknown to the customers). In the first case, the servers 
serve according to the rule given by 1 > 2 > • • • > N. Thus, when a server becomes available, it 
admits into service a customer in the buffer with highest priority (that is, least index) among all 
buffers that are non-empty at that instant. Under SFQ, the buffer that currently has most customers 
receives highest priority (where ties are broken arbitrarily). At each buffer, the customers are always 
taken from the head of the line. We assume the non-idling condition, that is, that no server will idle 
as long as any customers are in the queue. 

Let (12, J^",P) be a probability space, on which all the random variables (r.v.s) introduced below 
are to be defined. The arrivals in each class occur according to independent renewal processes. Let 
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parameters A" >0, / G {1,2,... ,N}, be given, representing the mean inter-arrival times of class-/ 
customers in the /2th system. Let {M,(/) : l G N}, be independent sequences of strictly positive i.i.d. 
r.v.s with mean 1 and variance Cj A . Let 

E?(t) = sup{/>0: </}, f>0. (2.1) 

1 jt=t A ( J 

Then E" counts the number of class-/ arrivals up to time t. The parameters A" satisfy 

X" = nXj + \fnXi + o(v / «), (2.2) 

where A,- > 0 and A; € R are fixed. The service times of class-/ customers are assumed to be expo¬ 
nential with mean /i,. The potential service processes, denoted by {S;};_| .2....W, are thus assumed 
to comprise a collection of N mutually independent Poisson process, with rates / = 1,2,... ,N, 
respectively. They are assumed to have right-continuous sample paths. While the arrival rates are 
accelerated with n, the individual service rates are not. However, the capacity of the service pool 
grows due to the increase of the number of servers, n. The resulting traffic intensity is thus asymp¬ 
totically given by p ( , where p,- = A,/p,. We will assume the following critical load condition: 

J> = 1. (2-3) 

i 

The initial conditions, 

or (0) = ( Q'l (0), GS (0 ),..., GTn ( 0 )), y ( 0 ) = W ( 0 ), V? ( 0 ),..., % (0)), 

are -valued r.v.s representing the number of customers initially in the buffers and in service, 
respectively. It is assumed that the initial configuration satisfies 1 • Q n (0) > 0 implies 1 • l I J "(0) = n, 
reflecting the non-idling condition. 

For each n, the three objects 

{£"}«, {Si}u (Q'\0)X>m (2.4) 

are assumed to be mutually independent. The triplet (12.41) will be referred to as the stochastic 
primitives of the model. All r.v.s introduced below, describing the system dynamics, will be given 
as functions of the stochastic primitives and of the collection of decisions taken by the strategic 
customers. 

Thus, before describing the system dynamics, we introduce the notation for the decision vari¬ 
ables. The customers initially in the system do not participate in the game formulation, and there¬ 
fore in what follows, unless otherwise stated, the term customer will refer to those customers that 
arrive after time zero. A customer will be identified by a pair (/,_/), where / € {1,2,...,A} is 
its class, and j G N is its serial number in order of arrival. The collection of decision variables 
5 = {8ij : / G {1,2,... ,N},j G N}, where 8jj € {0,1}, specifies the decision of each of the cus¬ 
tomers. Having 5,/ = 1 [resp., 0] specifies that the /th class-/ customer to arrive decides to join 
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[resp., leave] the system. Let 

E?(t) E"(t) 

m)= I % m)= (2.5) 

j =1 7=1 

denote counting processes for joining and reneging customers. Let Q"(t) be the number of class-/ 
customers waiting at the ith buffer at time f, and let B'f(t) be the number of class-/ customers routed 
to the service pool by that time. Then we have 

Qi(t)=&(o)+E?(t)-m)-m ). (2.6) 

Let denote the number of class-/ customers in service at time f. Then 

= (2.7) 

where the departure process D •' counts the number of completed services of class-/ jobs since time 
0 (including initial customers). It is assumed that the departure process is given, in terms of the 
potential service process, by 

D n i (t)=S i ( K j\;\u)du s j . (2.8) 

The non-idling condition is expressed by requiring 

for every f, 1 • Q"(t) > 0 implies 1 • T"'(f) = n. (2.9) 

Under the FP policy we have 

ZQk(t)dBKt) = 0, / = 2,3,... ,7V. (2.10) 

-“) k=i 

And under SLQ, a server that becomes available at time f chooses class /q, where /q G argmax, Q" 
(where ties are broken in an arbitrary, but concrete way), namely 

/ ^{Q"(t-)<max k Q"(t-)}dB"(t) = 0, i=l,2,...,N. (2.11) 

The collection of equations (12.51) — (12.9b and either (12.101) or (12.111) . along with the primitives and the 
decision variables 8, uniquely define the processes Q n , X n , l P", B" and D n under each of the two 
policies. Note that these processes are right-continuous by construction. 

Now let 

777(f) = inf {5 > t : J?(s) > 7"(/-)}, (2.12) 

(where, by convention, 777(0—) = 0), represent the time of arrival of the first class-/ customer to 
join the system at or after time t. Let also 

RT^t) = inf{.v > t : B'!(s) > B"(777(f)) + G?(777(f))} . (2.13) 

Then RT,'(t) gives the time when the customer joining at 77]'(f) enters service. The time that par¬ 
ticular customer waits in the queue is then given by 



W?7 (f) = 7?77 (f) — 777 (f). 


(2.14) 
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Note that, as a consequence, 

2i(^W) = + WTJ (t)) - B" (JTI (t )). (2.15) 

(JT, RT, WT as well as AT defined below, are mnemonics for joining time, routing time, waiting 
time and arrival time.) We shall also need notation of arrival time and waiting time of the jth class-/ 
customer. These are obtained as follows: 


A11 = in vEf(j) = infjr > 0 : E?(t) > j}, 


WT-j = WT-(AT!j). 

Note that while VVT'j is well-defined for all it only gives the waiting time for those customers 
(i.j) that have actually joined the system; this concept is indeed meaningless for the reneging cus¬ 
tomers. Scaled versions of the main stochastic processes introduced above are defined as follows: 


Q n i{t) = 

m= 

m)= 


m) 

y/Tl ’ 

m) 

yjn ’ 

m)-K* 


B'Kt) = 
S’l(t) = 


B'l(t) — nXit 
Sj(nt) — nfXjt 


r (0 = 


^ ’ 
Tit)-Pin 


D n i (t)=s n A / w;\u)du 


y/n 


Also define, 

WT) (?) = y/TiWTI(t), Wf'lj = \fnWT\j. 
It is assumed that the scaled initial condition converges in distribution: 

(!2"(0),^(0))^(0,*R(0)), 


(2.16) 


(2.17) 


(2.18) 


where ‘R(O) is an E' v -valued r.v. with ]T, 'fj(O) < 0. 

This completes the description of the stochastic processes of interest. We denote the collection 
of processes, that we will sometimes refer to as dynamics, by 


y n = y n [8] = (J n , R n , Q' 1 , B ", W , D ", JT 1 ,RT', WT l ), 

where we emphasize the dependence of these processes on the decision variables 8. We will use 
similar notation to emphasize the dependence of each of the components of ,9 J " on 8, as for example 

Q n [5]. 

Now we come to the game-theoretic setting. It is described for fixed n. In the game, the dynamics 
described above will serve as the game’s state. The game is played by the customers to arrive up 
to time f, where T e (0,°°) is fixed throughout. A decision is made by each customer once the 
queue length of the corresponding class at the time of arrival is revealed to it. Thus for our purpose, 
a strategy is a mapping a : Z + —» {0,1}. We denote the set of all such mappings by L. A strategy 
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profile is an element of E := X' 1,2 . iV r xK . Let a strategy profile a = {o,j } E E be given. We say 

that the game is played with the strategy profile <J if one has 

f = y'fiA"}. (specifically, Q" = Q"[A>% 
j A?j = a tj (Q';(AT; r )), i E {1,2,... ,N}, j € N. 

Thus ,9 /n is the dynamics resulting from having each customer (i,j) adopt the strategy a,-j, and 
A"(j) is a r.v. representing the action taken by customer (/'. /) in that situation. An argument by 
induction on the times of arrival shows that the system of equations (12.191 ) has a unique solution, 
and thus A/" and A n are well-defined r.v.s. We will also need a notation for the dynamics 59 n , thus 
determined by (12.191 ). as a function of the strategy profile a. We write it as 59 n (p). 

We formulate the payoff for customer (/, j) by accounting for a cost associated with not receiving 
service (in case of reneging) and a function of the waiting time (in case of joining). To this end, we 
are given constants r t > 0, i E {1,2,... ,N} and functions h t : R + —> R + , assumed to be continuous, 
strictly increasing and to vanish at zero. For a strategy profile <J = {(J, 7 }, denote c lJ = { o^j : (k. I) 

(, i,j )}. The payoff for customer (/, /), when the strategy profile a is played, is given by 




n, A?(j) = 0 , AV-j < T , 

< hi(WT-j), A" (j) = 1, AT-j < T, 

0, AT-j > T. 


( 2 . 20 ) 


Thus, according to the payoff definition, the game neglects all customers arriving after time T. 

For fixed n and e > 0, and an event Q E ,9, a strategy profile a = {<7,y} is said to be an e-Nash 
equilibrium on the event tl if 


V(/J), VteZ, Cfj(aij,a ij ) < C?-(t, o ij ) + e (2.21) 

holds on Q. A sequence of strategy profiles {(7"}n€N is said to be an e-Nash equilibrium w.h.p., 
if there exist events £2 n , n E IT, such that, for every n, a" is an e-Nash equilibrium on Q n , and 
IP(X2”) —> 1 as n -E 

For each n and (L j), consider the strategy 

Oy(?) = j 1 ’ lf/Z '(^) - ni q E Z+. (2.22) 

[0, otherwise, 


Theorem 2.1. For any e > 0, under each of the two scheduling policies defined above, the sequence 
of strategy profiles {a"} defined in (12.221 ) is an e-Nash equilibrium w.h.p. 


Toward proving this result, we analyze the diffusion scale processes, and, along the way also 
obtain diffusion limit results. These are Proposition [331 for FP, and Proposition 14.31 for SLQ. 


Remark 2.2. RSP does not always hold. One of the main issues we address is the validity of RSP 
under the scheduling policies considered. In order to prove the main result, this principle needs to 
hold in a strong form, namely that, w.h.p., every customer arriving, and joining, in the given time 
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interval [0, T], experiences a delay given, with high precision, by the ratio between queue length and 
arrival rate. It should be noted that this property is not valid for arbitrary scheduling. For example, 
consider a scheduling that prioritizes class 1 over class 2 up to a certain fixed time, to, and then 
switches to the a priority of 2 over 1. The standard prediction is that the diffusion scale waiting 
time for a class-/ customer is approximately given by WT ~ Xf 1 Q; = (PiPf) 1 Qh where Qj is the 
diffusion scale queue length at the arrival time. Now, consider a class-2 customer present in the 
buffer at time to- Such a customer will be sent to service approximately (pipi + P 2 /J 2 ) _ 1 r/ units 
of time after to, where q = n ^ 2 q, and q is its position in line at to, because when 2 has priority, 
every server in the pool to become available will pick a customer from buffer 2. Flence, w.h.p., 
most customers that are in buffer 2 at time to, that are, in fact, 0(y/n) in number, will experience a 
delay significantly different than that predicted by RSP. This number increases even further under a 
policy that switches priority many times during the time interval in question. While these policies 
may not be particularly interesting by their own right, this discussion shows that there is content in 
the assertion that the principle does hold for the policies of interest. 

Remark 2.3. Individual decisions may have long term effect. The analysis must take into account 
the possible behavior of customers that do not follow the proposed rule. At the technical level, the 
estimates that lead to existence of diffusion limits are dealt with for different behaviors of customers. 
It may seem that it is enough to consider the behavior of the system when all customers follow the 
proposed rule, and then argue that the behavior of a single customer will have a negligible effect. It 
should be noted, however, that the decision of one customer may affect significantly the waiting time 
of other customers. As a simple example for that, consider a two-class system under FP, where, at a 
certain time, a high priority customer arrives to find an empty buffer of its own class. If he decides 
to leave, and for a little while there are no new arrivals, then the first-in-line customer at the low 
priority class will get served as soon as a server becomes available. If he joins, it is possible that 
a large number of high priority customers will join soon after, so that the waiting time of the low 
priority customer referred to above will delay considerably. Hence a single player’s decision may 
have a significant effect on other players. 

3. Fixed Priority 

This section is devoted to a convergence result in the case where the servers implement the FP 
scheduling. It provides the main estimates that determine the limiting behavior of the fluid and 
diffusion scaled processes, that are later used to prove RSP. 

Throughout, a" = {} denotes the strategy profile (12.221) . Given (/./), denote by a'l € E the 
strategy a/' = 1 — Oj", that acts precisely as the negation of oj". We begin by noting that in order 
to show that a" is an £-Nash equilibrium w.h.p., it suffices to consider (12.211) with t = A" only. 
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Indeed, given (i.j) and t £Z, define A = {q E Z + : t(#) / Then we have 

c n , njj, = if Q^ATlj-) G A, 

,A ’ \C”.(c7",cy""), if Q1(AT-j—) E A c , 

and so the validity of (12.211 ) for t = a," and t = a/'- (the latter being trivial) implies the validity of 
this inequality for t € Z. 

We will use the term scenario for the collection of processes obtained under any one of the 
strategy profiles (a," , <r" ,u ). More precisely, let us fix n. Recall that, for (TGZ, ■ (o) denotes the 

dynamics obtained when a strategy profile o is played. Let 

6 = {(i,j) : i € {1,2,... ,N}, j EN}. 

For s = (i, j) E 6, the scenario s is defined to be ■'/'‘'{a'i. G n,l i), namely the dynamics corresponding 
to player (i.j) playing a/' and all other players (k.l) playing <7^. In addition, scenario 0, that we 
will also call the reference scenario, is defined as //'"{o"). Scenarios are thus indexed by the set 
©o := 6 U {0}. As we have just argued, the main result will follow once we show that there exist 
events £2 n such that, for every n, on Q n , 

V(i, j) C"j(G-j, <T n ’ ij ) < C"j(d"j, <J n,ij ) + £, (3.1) 

and P(i2") —> 1 as n —> We thus work in what follows with scenarios. In order to address all 
scenarios simultaneously, the dependence of the processes on the scenario has to be reflected in 
the notation. For each of the processes introduced above, except for the stochastic primitives and 
their scaled versions, an additional superscript s will indicate that the process is considered under 
scenario s € ©o- Thus, for example, Q n s = Q"(6]j, a' w ) if 5 = (i,j), and Q’ hS = Q n (o n ) if 5 = 0. 

Throughout what follows, we adopt the convention that e rLS (t) (or sometimes e\' s (t )), t E [0,T], 
denotes a generic family of processes, indexed by n E N and s E ©o, that can change from one 
appearance to another, and has the property 


sup ||e' ,rS ||r —>• 0 in probability, as n — >■ °o. (3.2) 

The balance equations (12.61 ), (12.71 ) and (12.81 ) have the following form when translated to the 
diffusion scale, namely 


erw = Gi (0) +E?(t)-B n f\t)-R n f\t) +n- 1/2 (V -nli)t , 

*fr (0 = 4T(0) + B? (t) - 5” ( f wr{u)du] - At, f q n -\u)du . 


(3.3) 

(3.4) 

\jo / JO 

Let Xf ' = Q" "' + i ¥" s represent the total number of class-/ customers in the system, and let its scaled 
version be defined by 

X.' s (f)-pin _ -- - 


xrf) = 


\fn 


Q n f s (t) + { P" ,s (t). 


(3.5) 
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Then by the assumptions on the initial conditions we have 

X n (0)^'F(0)=:X 0 . 

Our first estimate addresses the scaled queue lengths of the high priority classes. 


Lemma 3.1. For i = 1,2,... ,N — 1 and for any T < °° we have 

sup ||<2- M ||r —> 0, in probability. 

S 

Proof. By the functional central limit theorem, 

(E n ,S n )^{W u W 2 ), (3.6) 


where W\ and W 2 are independent iV-dimensional BMs, with W\ a (0,Ai)-BM and W 2 a (0,A2)-BM, 
A[ = diag(A,Cj A ), and A 2 = diag(ju,-) (see Section 17 of O). In particular, the sequence ( E n ,S n ) is 
C-tight. 

Fix e > 0. Define the event 

N— 1 

*2" = { £ G?(0) < | and Tf(0)>p,-| for all i E {1,2,... ,N- 1}}, 
where £,■ = ( f . . Then by the assumption (12.181) on the initial conditions we have P(T>") —>• 1. 

flj [IX 1 ) 

For s E So define 

r tv-t , 

t""' = inf 11 > 0 : ^ Q n i'\t) > e or x FF s (t) < pi — £, for some / E {1,2,... ,N — 1} >. 

Let A n ’ s = {z n f s <T}. Now let 




A"’ s 

= {»€!■': eV( 
*• (=1 


>£|ni2", 


( 

N-l 





A >w 

= •IlDEA" 
l 

’ S --L 

ere 

rr) < £ and >/f" 

s ( jn.s 
( T i 

) <Pi~£i\nQ n , i<N 



k= 1 




) 

For a> E A""' 

there exists 

^.n,s 
°1 = 

= <■'( 

co) such that 




At—1 


p 



N-l 


I Q n f 

i= 1 

) 

c 

- 2’ 

and, on /”’ i : = 

r —n,s 

Eer>o- 

(=i 

Throughout, 

for 0 < t\ < t 2 < °°, / = 

[ii,i 2 ] and / : M + 

—> R. 

, we use the notation 


f[ h , t2 ]=f[I]=f[t 2 )-f[h). 

By (12.61) and the fact that R" is nondecreasing, we have on A” ,s 

¥ < e erw < e wi - E wt 0-8) 

Z j=l i=l i= 1 

By 03 and ( fT9l) . 1 • «F»>*(f) = n for t = a n f s and t = z"'\ Thus by (flTi 1 [/"’"] = 1 ■D" J [/p v |. 

Moreover, since by (13.71) the high priority buffers are non-empty on the time interval of interest, the 
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priority rule expressed by (12.101) dictates that the process B'^ s does not increase on that interval. As 
a result, the last term in (13.81) equals 1 • D' hs [l"’ s ], and 

P JV-l N-l'\n( T n,s_ n,ss N N „ T "’ J 

f < E ffffl + E ' 11 /- 1 1 - - n- 1 ' 2 E* . 'K'W*- 

z 1=1 i=l V« i= 1 (=1 •'<V 

On the time interval under consideration we have for i < A that l F" ,s > /it),, where 5, = p,- — £,-. Thus, 
denoting p min = min, p, > 0, 

£ ,uAf !S = *£ p,(nS ; - + ff* - „$) + p ^’ 1 
1=1 1=1 

> n ( £ A,- -e) + - «5,) + p mm *f^ 


1=1 

A-l 


i=l 


— H ^ A/ £ T Pmin Pn T PnunL^j ■ 

where the last equality uses the fact that YliLi ' = n that is true thanks to the non-idling condition 
(12.91) and the fact that, by 13,71) . the queues are not all empty. Therefore for £ small enough there 
exists a 5 > 0, such that 

£ Ah [i ( u ) du > n( £ A+ 5)(rp'' - a""'). 


1=1 


1=1 


Hence we have 


A-l 


i< e £,"[/n-ED'"‘w 


1=1 


AT 

L 

i=i 


+ £-7=-vnSfa -<V )• 

1=1 V n 

n.s n.s 


Let r„ > 0 be a sequence such that r„ —>■ 0 and y/nr„ —> if z"’ s — a" 1 < r n then 

I < £ w T {E- , r„) + £ w T {S" ,r n )+ Kr n , 


i=i 


i=l 


where K is a constant and, throughout, for / : R + —) M. k (k a positive integer), 

WT(f,a) = sup{||/(f)-/(s)|| : s,t € [0,T], |f-s| < a}, a> 0. 


On the other hand, if Tj ’ — Of ’ > r„ then 

„ IV-1 


w-i 


-< 2 £||Ar|| r + Ar + 2£P«|| r -^. 

z i=i i=i 

Hence by (13.61) and the resulting C-tightness of E" and 5", we have 

P(u s A?’ s ) —)• 0, as n —>• oo. 

Next, on A^’*, for i < N — ] fixed, again there exists a time o"" s = o""'(( 0 ) such that 


(3.9) 
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Thus*"’*[/"’*] < VHe-f, 


or 


n£i 


and therefore 


whence 


e? m -Dvr/) -vy/} <v*s--f, 


s.nrw.fl /yviwi , iK ~ n ^i)^\ S - G V) / „ Vn£i , 1 


Wj-W'R- 




<£- 


2 + 'V^ 


-2\\E?\\ t -\\S?\\ t -KT <£-2^ + -L. 

2 \Jn 

Therefore by the tightness of | E'- 11 T and ||S"|| r , n £ N (for T fixed), we have 

P(u s A 2 ’ v ) —> 0, as n —» °o 5 / < TV — 1. 


(3.10) 


Putting together the estimates (13.91 ) and (13.101 ). we obtain P(n, s (A' v ) c ) —y 1. Since £ > 0 is arbitrary, 
the result follows. □ 


Define 

d i = ?i i hr\r i ), (3.11) 

and note that these constants are positive. By (12.221) . under the reference scenario, class-/ customers 
always renege when the scaled queue length Q •' is in the interval (0,. 0, + -W and therefore the scaled 
queue length never exceeds that bound. Under any other scenario, there is at most one customer that 
does not follow the rule (12.221) . and so we have 

Q"’ s (t) < 0,-+ 2n -1/2 , t>0,n€N,s€& 0 ,i = l,...,N. (3.12) 

Conversely, a class-/ reneging will never take place when hi(Q n f s /A,-) < r,-, except, possibly, by a 
single customer. 

Lemma 3.2. /. For i = 1 , 2, ..., N — 1, 

sup R'] ,S (T) —y 0, in probability, as n —y °o. (3.13) 

//. For / = 1,... ,/V, 

sup — p,-|| r —>• 0, in probability, as n —y °°. (3.14) 

S 

Proof, i. By the discussion preceding the Lemma, R n f s (T) < 1 on the event that || Q”’ s ||r < 0,. Hence 
(13.131) follows from Lemma [3711 

ii. We begin by proving the result for the high-priority classes. Thus, fix / < N — 1. We have by 

dm 


Qnt)=QK0)+E’\t)-B’!- s (t)-R r r(t) 

= <2"(0) + (Ff(0 - A;/) - (^(0 - A,./) - R? s (t). 
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By the functional law of large numbers, sup 0<(<7 - \E' l (t) — A,t| —>• 0 in probability. Hence the esti¬ 
mates of Lemma l3.1l give (recall the convention (13.21) 1 


& 1 i ' s {t) = l i t + e n t ' s . 

Next, by (12.71) and (12.8b . using the identity p, = A,/p,, 

- p, = *ff (0) - P i + (B"’ s (t) - A it) - X - \Si (J\'P?’ s (u)di?) - piJ'nW^{u)di 

-Pi [ {^ S {u)- Pi )du. 

Jo 

Using the fact W"’ s < 1 we have, for t £ [0, T], 

\^"’ s (t)~Pi\ < |^"(0)-p<|+/3r + «“ 1/2 ||5"llr + P/ / sup sup |»if ,s (r) - Pi\du. 

JO s 0 <r<u 


(3.15) 


It follows from (12.181) that | l F"(0) — p|| —>• 0 and from the law of large numbers for the Poisson 
process, that n -1 / 2 ||5"||7’ —>• 0, in probability. Using these facts along with (13.151) . the result (13.141) . 
for i < N — 1, follows upon applying Gronwall’s lemma. 

Next we consider the class N. Because £p, = 1 and £ l P i "' s < 1, we have from the validity of 
d!) for i < N - 1, 


sup sup -p N ) + 0 

s 0 <t<T 

in probability as n —>• Using this and the assumption on the initial conditions, the probability 
of Q" := {/' < e/16} n {|*f^ ! (0) — p^| < e/2} converges to 1, where y" = sup ^ —p||r- 

s i<N— 1 


Now let 


Q ns = {co: inf %’ s (t)<p N -£}. 

0 <t<T JV 

Then for co € O n,s D (| l f^(0) — p^| < e/2}, there exist times 0 < a"’ s (m) < Tp ,v (<y) < T such that 
> Pn - | <p N -s and %' s (t) < p N - | for all t £ I n ’ s := [a"’*, x"’ s ]. 

Also, on the event Q n,s n |y" < e/16}, 


N— 1 

I 

i= 1 


£ < I* pi + 4 for a11 f e 

;=i 


16 


Thus on I n ' s we have £//, < 1 — e/16 < 1, which implies by the non-idling assumption that, 

on this time interval, we have £^ =1 = 0. As a result, on this time interval there is no reneging 

under the reference scenario, and there is at most one reneging under any other scenario. Recalling 
that X n,s = Q n s + and using (12.61) and (12.71) . we obtain, for a given scenario s, on the event 

Q'l n n ,u \ 


ne 


-y >X n /[I n ’ s ] > E n N \r s ]-D n ^ s ] - 1 


= VTiE»[I n ' s ] + - o'^) - y/Wgr*] - np N [ %'\u)du - 1 . 

Jl 'V 
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Note that 

Ahv f %'\u)du < p N p N (^ s - <) = ~ ° n 3% 

Ji n ’ s 

thus 

Jl^llr ; Wr , W-4)(^-^ j 

2 — yTz sjn n n 

Since 0 < { P^’ S < 1, we have ||D' !,,S || 7 ’ < ||S' , || 7 '. Also, — nAjv) converges. Hence 

JEnWt J^llr KT 1 

2 — \fn \J7i y/n n 

By the tightness of ||£^||r and |11 j for 72 € N (and T fixed) and the fact that P(i2") —> 1, we 
obtain P(U. v I2" i ) — > 0. Since e > 0 is arbitrary, the result follows. □ 


Consider a stochastic differential equation with reflection, for a process Y that lives in 

G={y€ M. n : l-y<0 N }, 

and reflects on the boundary of G in the direction —e^. Let {W(t)} be a (A,A)-BM, where A = 
diag(Ai(Cj A] + 1),.. .,X n {Cj An + 1)). Let b : R N ->• be given by 

b(y) = -(piyu..., PN-iyN- 1 , Pn(jn ~ (1 a) + ))- (3-16) 


Let (X,L) be the unique pair of processes that is adapted to the filtration a(Xo) V <j{W( it).u < t\, 
where X has sample paths in Cg, L has nondecreasing sample paths in C R+ , and the pair satisfies 


a.s., 


X(t)=X 0 + W(t)+ f b{X(u))du-Ut)e N , t> 0, 

Jo 

j {) x G-x(t)<e N }dL{t) = 0. 


(3.17) 


The existence and uniqueness of such a pair follows from Proposition 3 of 0] on noting that b is 
Lipschitz. We call this pair the solution to the SDE (13.171) . 

Define r : D r jv([0, T]) —» B r at([0, Tj) by 


r(f)(t)=f(t)-g(t)e N , g(t) = sup (0At-!■/(«)) • (3.18) 

0 <u<t 

The following two properties follow directly from the definition, namely there exists a constant C 
such that 

\\r(f)-r(f)\\ T <c\\f-f\\ T , /,/€ B R iv([o,r]), (3.19) 

and 

w T (r(f),-)<Cw T (f,-), /e B RW ([o,r]). (3.20) 

Given z € B r jv, z(0) G G, we say that (y, i) G B R /v x B R solves the Skorohod problem (SP) in G, with 
reflection in the direction —e^, for data z, if y(t) G G for all t, t is nonnegative and nondecreasing, 
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and 

y = z-lt N , / l{i. y< e N }d£ = 0. 

J [0,°o) 

It is well known that for z as above, a necessary and sufficient condition for (y,£) to be a solution 
is that y = r(z) (this follows e.g., as a special case of the much broader result of 0). This will be 
used in the proof below. 

Denote 

3 n _ „ 3 . r-t 

w!'' s {t) = E"(t) + ' ' t-s“( / yy(u)du). (3.21) 

y/n Jo 

Recall conditions C1-C2 from Section [Qthat characterize C-tightness. We will say that a sequence 
of processes n £ N, .v <E ©o, with sample paths in D R / ( , is C-tight, uniformly in s if 

Cl'. The sequence of random variables ||^ n,s Hr is tight for every fixed T < °o, and 
C2'. For every T < °o, e > 0 and t] > 0 there exist no and 6 > 0 such that 


n > n o implies P(supw 7 ’(i§' , " ? , 0) > r\) < £. 

S 

Proposition 3.3. The sequence (IT" ', X' LS . R n s . Q n,s . { P n,s ) is C-tight, uniformly in s. Moreover, 
(W n ’° j X n ’ 0 ,R ,1 ’0,Q n ’0, , P n ’0') converges in distribution to (W,X,Le^, Q, *¥), where (X,L) form the 
solution to the SDE (13.171) . and 

Q = (l-X) + e N , 'F = X-Q. 


Proof. The C-tightness of W n,s , uniformly in .v, follows from (13.211 ) using (13.61) and the fact that 
'F i n - S < 1. By dH-dH), 

X"’ s = X" (0) + W”’ s - Pi I p; i s ( u)du - R n f s . 

Jo 

Thus 

'P?' s =X?(0) + wy-Qy-pi f 'Pf l,s {u)du — R n f s , « = l,...,iV-l, 


.N -1 


and, noting that by (12.91) one has 1 • Q n s = (1 -X n ’ s ) + , 

X^=X^(0) + W^-p N [ {X^{u)-{\-X n ’\u)) + )du-p N I £ Q n i ,s {u)du-R n jf 

Jo Jo “ 

= X”(0 )+W"’ s -p N [ (X”’ s (u)-(X% s (u)+ N £'P?' s (u)) + )du 

J o “1 

-UN fZ&i' S (u) d U + PN f {(1 ■X n ’ S (u)) + -(XZ\u)+Y*r(“)) + }d“-K n N- 

Defining Y""' = X P"’ S , i = \.... .N — I, and = X£,’ s , we have, using Lemma l3Tl and Lemma lT2l i). 


Y t n s = X? (0) + W?* - Pi / Y?'\u)du + e n ff i = 1, ... ,7V - 1 , 

Jo 

Y n / = Xtf(0) + W n N s -p N f (Y”(u) — (1 ■Y n ' s (u)) + )du — R n I f-\-e n ’ s . 


(3.22) 


(3.23) 
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Let 


F n,s = \-Y n ' s /\6 N -\ Y‘ 


Then 


N -1 


1 • Y n ’ s = X n N s + £ W"’ s = Q n jf + 1 • ^ < Q n tf < e N + -= , 
1=1 v 71 


(3.24) 


(3.25) 


by (I3.12I ). Thus |F' i,s | < -2=. Further define Y"' s = Y’ l)S + jr/ 7 ""', i = 1,... .A 7 . Then K' LV satisfies 


Y' l ’ s (t) € G, r > 0 , 


(3.26) 


and, as follows from (13.161) . (13.221) and (13.231) . 

Y n ’ s =X n (0) + W n ’ s + [ b(Y n ’ s {u))du-R n f l s e N + e n ’ s . (3.27) 

Jo 

Under the reference scenario, no class-A 7 reneging occurs when Q n '° < On , that is, 

/ 1 («VXM'<<'>= °- 

As a result, the same is true with replaced by Under any other scenario, there may 

be one customer that does not follow the rule. For s = {N,j), j € N, write R'tf for the normalized 
reneging count of all class-A customers except for customer (N,j) (if it reneges). For any other 
s £ 6 o, let R^ = R'^ s . Then R n N ' s is nondecreasing and satisfies 

<«-’ /2 , (3.28) 


and 

J l {&N S ( t )<0 N } cl ^N (0 =0 - 

Let us show that 1 • Y n,s < On implies Q^ s < 0y. Indeed, by (13.241) . the former implies that 1 • Y n,s < 
On- Now, 1 • Y n,s = Q n ^ s + 1 • x P n > s , by (13.251) . Thus either Q'^ s = 0, or Q'^ s > 0 in which case 
1 • T" ,s = 0 by the non-idling condition (12.91 ). In both cases, Q n ^ s < On- It thus follows that 

(3.29) 


l{iy n - s <e iV } fi ^v — 0. 


By (1T271) and (fT28l 


Y n ’ s = X n (0)+W"’* + 


[ b(Y n ' s (u))d, 
Jo 


u - R n -- s e N + e n s . 


(3.30) 


Hence from (13.261) . (13.291 ) and (13.301 ). (Y n,s ,R'^ s ) solves the aforementioned SP for the data 

X n (0) + W n ' s + f b(Y n ' s (u))du + e n ’ s . 

Jo 

Therefore 


Y n ’ s = r [X n (0) + W n ’ s + / b(Y n ’ s (u))du + e n ’ s ), 


(3.31) 


R ns e N = (/-r)(A M (0) + IT”’" + 


[ b(Y n ’ s (u))d , 
Jo 


u + e‘ 


n,s 


(3.32) 
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The convergence of A"(0), the uniform C-tightness of W n,s , the Lipschitz property of b and the Lip- 
schitz property of F, as expressed by (13. 19b . imply tightness of the r.v.s sup ? 11 K"'' v 11 7 -, upon an ap¬ 
plication of Gronwall’s lemma to (13.311) . Hence, using again (13.311) . along with the property (13.201) . 
shows that the processes Y ns are C-tight, uniformly in s. As a result, R n f s are also C-tight, uniformly 
in 5 . By equations (13.301 ). (13.311) and (13.321) . any subsequential weak limit of (W n, °,Y n ’°must 
be equal in distribution to ( W,X,L ). As a result, (W' h °,Y' h °,R'lf) =4> ( W,X,L ). From the definition 
of Y n s and Lemma I3T1 it follows that X n s = Y ns + e n,s . Moreover, since by Lemma I3T21 R"' s = e n,s 
for i < N- 1, we have (W"’ 0 ,*"’ 0 ,/?"- 0 ) => (W,X,Le N ). Finally, the fact Q" s = e n ’ s , i<N- 1, 
stated in Lemma [3711 and the relations 1 • Q"' s = (1 ■ A^" ,v ) + , l P" s = X"’ s — Q n s yield the result by 
the continuous mapping theorem. □ 

4. Serve the Longest Queue 

In this section we carry out our analysis under the SLQ scheduling. The crucial property in this 
case the state space collapse exhibited by the queue length processes. Recall the constants 0, from 
(13. lib , that determine the upper limit on the value attained by Q n f s . While in the previous section 
the threshold of the least priority class, 0V, was significant, under the current service policy, the 
property that queue lengths remain equal makes the minimal threshold important. Thus, assume 
that the classes are labeled in such a way that 

0, >••■ > 0,v, 

and let M = min{;: 0, = We first treat the case M = N. 

Lemma 4.1. Assume M = N. Fix T. 

i. For i = 1,2,... ,N we have 

sup \\Q"’ S — N~ l ( 1 • A" , 1 ) + || 7 ’ —> 0, in probability, as n -y °o, 

S 

sup I'/''""' — P;||r ~> 0, in probability, as n 00 . 

S 

ii. For i = 1,2,... ,N — 1, sup v /?' , ‘' (7’) —> 0, in probability, as n —> °o. 

Proof. Fix e > 0. Let £1 = { ^ and consider the event 

Q n = |<2"(0) < ^ and |*F"(0) — p,| < for all i=l,...,iv|. 

Then it follows from the assumptions that F(Q") I. For s € ©0 define 
z n f s = inf I? > 0 : min Q"’ s (t)-N~\ 1 -X n ’ s (t)) + < -£, 

or \ x ¥F s (t) — p,\ > £1 for some / = 1,... ,N — 1, 
or \% ,s (t) - p N \ >fi|. 
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Let A n ' s = {z n { s < T} and A" = \j s A n ' s . Now let 

A"’*’ 1 ' = {&) € A n ' s : Q’YYY) -X n ' s (r | M ))+ < -e} nQ n , i = 1,... ,7V, 

A n Y l = {( 0 £A"' S : min<27(0 ~N~'0 -X n ’ s {zY)) + > -e 
j J 

and \WY\zY) — Pi\ > £i} FI i2", i= 1,...,7V— 1, 

A n 3 ' s = {(0 £A" ,S : mmQYYY)-N~\l-X n '\zY)) + > 
j J 

max m'\zY)- Pj \<£u 

]<N —1 J 

md\%' s YY)-p N \>£}nQ n . 

For (0 € AY’\ there exists a" s such that 

QYK s )~N-\ 1 •X"’ i (a 1 "’ i )) + > ~ and, on := [a n { s -N~\l ■X n ' s )+ <0. 

(4.1) 

Note that 1 • X n,s = 1 • Q n,s , hence, on the time interval l"’ s , the ith queue length is less than the 
average. Since the scheduling policy always chooses the longest queue and on this time interval, no 
customer from class i enters service. Therefore the class-/ queue length can only increase during 
this period. Thus we have 


(4.2) 


(4.3) 


N-\i-x n ’ s ) + [iY]= N ~ 1 (i-Q n ’ s ) [ I i ,s \>QY[ I i s ] + 2' 

HeneeAr 1 I^-e7>§, and so by the balance equation for Q n s , (12.61) . 

e XY < EeyKI < JW - 

“ .//' j/< J'l 

Since, as argued above, B"’ s [I n,s ] = 0, it follows that the last term of (14.31) equals 1 • B n ^ s [l"' s ], and 
since 1 • P Jns = n on this interval, it follows from (12.7b that the same term equals 1 • D n ’ s [/" ,,s ]. The 
argument from Lemma [3TTI (following (13.81 )) now shows that P(lAA"' v ) —>• 0. 

Now we analyze the event A'Y’'■ By (12.71) . 


sno - Pi = r (o) - pi+(*?(*) - v) --m 

n V Jo 


n ' s,t ^ 1 ^ ^ (enf [ TJ " ,S (u)du) — fa [ n x ¥’ ls (u)d. 

Jo 


Pi 


f (WY s (u)-pi)du 
Jo 


= ff (0) - Pi + (E?(t) - kit) - - S?( / nW"’ s (u)du) - p t / n^’ s (u)du 

n \ Jo Jo 


Pi 


i f^r(u) - Pi)du - QY(t)-RY(t) ■ 

7o 

Thus, for / e [0,T], 

1^(0 - Pi\ < 1^(0) - Pi\ + m - A,- • llr + n- 1/2 ||S”|| r + WQYWt 

+R'Y(t) + Pi fmu)- Pi \du. 


(4.4) 
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And so by Gronwall's lemma we have 

1^(0 - Pi| < (|^"(0)- P/| + \\E?-Xr\\ T +n- 1/2 ||S"||r + \\Q1' s \\t+R-’ s (t))e^ T . 

Using the identity (1 • X n,s ) + = 1 • Q ns , we have on A"’ s '' that min,- Q" ,s > TV 1 1 • Q"' s — £ up to the 
time tA s a result, max, Qj s < N 1 1 • Q ns + Ne. Using the fact that the queue length is limited 
by — 0v + 2/i 1 /2 at all times, it follows that for all large 77, up to time t"’\ 

max QY < 6 N + (N + l)e. 
j 1 

Hence, if e is sufficiently small then up to time t”"' there can be at most one reneging of class-j 
customers for j <N — 1. Thus, on A" SJ , we have 

£] < - p/1 < (|«f*"(0) - ft-1 + ||£f - h • || r + n" 1 / 2 ||$|| r -h/T 1 / 2 ^ + l)+n~ 1 )e^ T . 

Using the convergence of E n and S n (13.61 ) and that of the initial condition (12.181 ). we therefore obtain 
P(U*A2 ,, ’ i ) ->0. 

Finally we analyze A" ,s . We have 

n-\ P 

\r/n,s /n.s\ ^ i iT/«yS / ~n.s\ ^ 

•*V (u )<i-L^ ( t i )<p^+t- 

7=1 4 

Thus by the way A*’ s is defined, we have l I J y S (?""') < p,v — £. And so there exists a” ' suc h that 

%'\c> 2 S ) > Pn ~ | and on [<*, <1, ^(f) < pAt - | • (4-5) 

Hence on [o^’*, t"’ 4 ], we have < LP/ + f — | = 1- Thus on this interval we have 1 Q n,s = 0, 

and so, the argument provided in the last part of the proof of Lemma lT2l shows lP(U v /4""') —> 0. 

We have thus shown that P(A") —> 0. The conclusion of item (i) now follows on using again the 
fact that min, Q": s > N 1 1 • Q" s — e implies max,- Q" ,s < N 1 1 • Q"' A +Ne. 

As for item (ii), recall that On < 0j for all i <M = N. Hence the assertion is a direct consequence 
of (13. 1 21) and item (i). □ 

Next, consider M € {1,2,...,A}. Fix a sequence k n , n £ N, such that limn 1 / 2 k n = oo and 
limn ] k n = 0. Given T < °o, define 

T njS = inf{t : 1 -R n,s (t) > k n } A T. 

We use the notation U* ,n,s = U n ' s {- A T n s ) for any process (/" ■', and refer to these processes as 
stopped versions of the original processes. The following result states that Lemma |4~TI is valid for 
the stopped processes. 
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Lemma 4.2. Consider general M. 

i. For i = 1,2,... ,N we have 

sup \\Q*' n ' s — N~ l {\-X* ,n,s ) + \\T —> 0, in probability, asn^-°°, 

S 

sup — pi Hr —>• 0, in probability, as n —>• °o. 

ii. For i = 1,2,... ,M — 1, sup v ^*' ,M (r) —>• 0, in probability, as n —>• °°. 

Proof. Note that, by definition, R* n s = e' ,s . Hence a use of (14.41) and again Gronwall’s lemma 
immediately give i F* ns = p + e n s , proving the second part of item (i) on the lemma. With this at 
hand, the remaining assertions are proved as in Lemma |4~T1 □ 

In the case where M = N, we provide a convergence result. We do not attempt such an analysis 
for M < N, where, as is shown in a work in progress (2]], the limiting behavior may depend on 
properties that are finer than first and second order data. Thus, for M < N, we only obtain C- 
tightness of the processes, that however will suffice for the purpose of proving the main result. 

In order to present the result regarding the case M = N, we consider an SDE of the form (13.171) 
with different domain G and drift b. Namely, we consider 

G = {)>€M' v : l-y<lV0jv}, 

and b : R^ —> R w given by 

b(y) = — (MtCvi —N -1 (l •y) + ),...,At w ()N-A rl (l •3 ; ) + ))- ( 4 - 6 ) 

The process W(t) is as in Section[3j and the SDE of interest is now 

X(t) =X 0 + W(t)+ f b(X(u))du-L(t)e N , t> 0, (4.7) 

Jo 

/ ^{\x{t)<N0 N }dL(t) = 0, 

J [0,0°) 

where a solution ( X , L) is defined similarly. The map F : D B .v ([0, T] ) —» D K v ([0, T] ) that is relevant 
for the present setting is given by 

r (f)(t)=f(t)~g(t)e N , g(t)= sup (N9 N -(l-f{u)))~ . 

0 <u<t 

Proposition 4.3. i. For general M, the processes W n,s , X n,s , R n s , Q n,s and l f / " ' are C-tight, uni¬ 
formly in s. 

ii. In the case M = N, as n —>• °o, {W n '°,X n,(> ,R n ’ 0 , Q n ’° j <p n ’°) converges in distribution to 
(W. X. , Q. l F), where (X,L) form the solution to the SDE (14.71) . and 

Q = N~\l-X) + '£e i , 

;= l 


'P = X-Q. 




22 


RAMI ATAR AND SUBHAMAY SAHA 


Proof. Step 1. In this and the next step we consider the case M = N. We have 

X"’ s = x;\0) + W"' s - Pi [ «E"- \u)du - R n f s 

J o 

= X?(0 ) + W? s - Pi [ (x^(u) - QY(u))du - R’r 
Jo 

= X? (0) + W"’ s - Pi f (Xf'» X n ' s {u)) + )du - R" s + e y , 

Jo 

where we have used Lemma l4~TT i) on the last line. Next, by Lemma l4~H ii). 

X n ’ 5 = X n (0) + W n ’ s + J b(X n,s (u))du - R n N s t N + e fLS , 

with b as in (14.61) . Define 

z n,s = + @V_ N - 1( 1 .*»*)+ f /= 1,... ,7V, 

and note that Z ns = X n,s + e n,s . Let 

K n,s = [N~\l .z n ’ s )\ Ad N -N~ l (l • Z n ’ s ). 


(4.8) 


Since 


iV _1 (l ■Z n ' s )=N~ 1 { 1 •X n ’ i ) + <2^-A r_1 (l •X"’*) 4 ' 

= n-'(\-'P"- s ) + Q ,1 n s 

<Q'^ <e N + 2n~ 1 / 2 , 

we have K ns = g"-*. Define Z"" 5 = Z-’ s + K n -\ i=l,2,...,N. Then 

N~\\-Z n ' s )(t)<e N , />0. (4.9) 

Moreover, Z" 1 = X n,s + e n,s , hence by the Lipschitz property of /? and (14.81) . 

Z n ’ s =X"(0) + W n ’ s + [ b(Z n ' s (u))du-R n d s e N + e n ' s . (4.10) 

Jo 

As in the case of FP, an argument based on the fact that under the reference scenario no class-/ 
reneging occurs when Q; < shows that 

J 1{a- 1 (i-Z". i )<0«}^a( = (4-11) 

for a nonnegative, nondecreasing process Rf' that is close to Rf' in the sense 


R^ = R^ + e n X (4.12) 

Step 2. To prove (i) (with M = N) and (ii), combine (14.91) . (14.101) (with R'ff replaced by R'f s ) and 
(14.111 ) to write 

Z n ' s = T (x n (0) +W n ’ s + J b(Z"’\u))du + e n ’ s y (4.13) 

R ILS e N = (7-T) (z"(0) + W n ’ s + J b(Z n,s (u))du + e . (4.14) 

The completion of the proof, based on the above, is precisely as in Proposition 13.31 
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Step 3. It remains to prove (i) for M <N. We start by arguing that conclusions analogous to 
those obtained in Step 1 are valid here too, but for the stopped processes. Indeed, working as in 
Step 1 with Lemma l4~2l in place of Lemma l4~T1 shows that 




X w =Z"(0)+W w + / ’ b{X n ' s (u))du- £ R*’ n ’ s ti+e n 


-A T„. 


z*' v =l"(0)|lf w | / ’ b(Z n ' s (u))du — £ R*' n ' s ti + e n 


N 

L 

i=M 

N 

L 

i'=M 


j ^{N- l (\-Z"’ s )<e N }dRi = 0) i = M,...,N, 
for nonnegative, nondecreasing processes R"’ s that are close to R"’ s in the sense 

R n, S= £n, S + e „^ j = M,...,N, 


(4.15) 

(4.16) 

(4.17) 

(4.18) 


(note that the above refers to the unstopped versions of the processes, because again (13.281) is valid). 
Denote 

r n 

£ n ’ s = l-Z"’*, Z n ’ s = 1-X n (0) + 1-W n ’ s + / l-b(Z n ’ s (u))du, p n ’ s =Y J R" S - (4-19) 

7o ;=M 

Then t, n ’ s and p" v have sample paths in Br, where those of p n,s are nonnegative and nondecreasing, 
and moreover, as follows from (14.9b . (14.15b . (14.17b and (14.18b . 

r*,n,£ _ p*,n,s , „n,s _*,n,s ^ / i 

Q =S + e P <MVn, 1 {^<N0 N } d P 

J [0,oo) 

It follows that p *’ n,s is given by 


= 0 . 


p w (i) = sup {Nd N -S*’ n ’ s (u) + e n ’ s (u))-. 

0 <u<t 

We now write c for generic constants and use the Lipschitz property of b. We have 

P*™it) <c+\\$*™\\ t + <P*(t) 


(4.20) 


< c + 


||X n (0)II + c|| W *’ n ’ s || f + c r T "' S \\Z n - s {u)\\du + e n ’ s {t). 

Jo 


Going back to (14.15b and recalling that p n s has been defined as the sum of positive terms, 

|| ?™(t) || < c||X' ! (0)|| + c||W w || f + c [' ||Z *’"’»\\du + e"’ s (t). 

Jo 

A use of GronwalTs lemma now shows that for T fixed, \\Z' KILS \\r, n G N, are tight, uniformly in s. 
Next, using (14.19b and the C-tightness of W*’” ,s shows that 5 are C-tight, uniformly in s. In turn, 
using (14.20b . shows that so are the processes p* ,n,s . In particular, for fixed T, 


p* ,n,s (T) are tight uniformly in s. 


(4.21) 
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Now, note that 


Af—1 


\.R*’ n ’ s (T)= £ R*’ n ’ s (T) + p*’ n ’ s {T) + e n ’ 5 


p*' n ’ s {T)+e n ' s , 


i= 1 

where we used Lemma l4~2l ii). Hence in view of (14.211 ). the definition of T n s , and the assumption 
lim/z -1 / 2 ^,, = oo, we have P(for some T n ^ s < T) —>• 0 as n —> Thus all conclusions we have 

obtained for the stopped processes are valid for the unstopped versions. Namely, are tight, 

uniformly in s, c, ns and p ns are C-tight uniformly in s, and (14.151) and (14. 161) hold without the 
asterisk sign. 

Using the last part of (14.191 ) and the fact that each of the processes R"'\ n G N, i = M,... ,N, is 
nondecreasing shows that these processes are also C-tight, uniformly in s. Hence by (14.151) . Z n,s , and 
in turn, X n,s are C-tight, uniformly in 5. Finally, Lemma l4~2l is now valid for the processes without 
the asterisk sign. Thus the uniform C-tightness of Q n,s follows from that of X n,s upon using Lemma 
14.214 ) and the continuous mapping theorem, and that of 4" l s follows from the identity (13.51) . □ 


5. Reiman’s Snapshot Principle and Proof of Main Result 


We finally state and prove RSP and obtain the main result as an immediate consequence thereof. 
RSP is based on the C-tightness of the processes B n,s , established as part of the limit results above. 
The two policies, namely FP and SLQ, are addressed here simultaneously. 

The proof uses the following identity, that holds regardless of the service policy, 


Q’l' s (jT’' s (t)) = B n p\jry{t)+wr;-\t)) - B^\jr;- s (t))+XiWf-\t). 


(5.1) 


and on properties of the processes involved in it. This identity follows from (12. 15b . and the definition 
of the scaled processes, (12.161 ) and (12.17b . The main argument is that the l.h.s. and the last term on 
the r.h.s. must be asymptotically equal once one has that B" ' are uniformly C-tight and the term 
Wf hs is small. 


Proposition 5.1. We have for i = I ..... Af 

fjf T) := sup sup |Q"’ i (/T”’' s (t)) — XiWTf (t)| — > 0 in probability, as n —> °°. (5.2) 

* te[o,T] 


Proof. First we argue that the results of Sections [3] and @] imply that B"~ s are C-tight, uniformly in 5. 
Indeed, by (13.31 ). 


B n f \ t ) = <2"(0) +E \?(!) + Xjt - Q n f\t) —R"’ s (t) + e"’ s (t). 


By (12. 1 8b and (13.61) . the sum of the first two terms forms a C-tight sequence of processes. By 
Proposition [33j Q’-' s and R n f s are C-tight, uniformly in s, under FP, and by Proposition 14. 3 [ the same 
is true under SLQ. Thus follows the uniform C-tightness of B n,s , and in particular, for i = 1,2 ,N 
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and £ > 0, 


limlimsupP(supw 7 ' + 2 (B"’ lS , 8) > e) —>0. 

5^0 fj —^oo S 


(5.3) 


Fix £ G (0,1) and define 


Q"" s = { sup | JT*’ s (t) —1\ > £} . 

/e[0,r] 


Then on D.'-' s there exists t € [0, T] such that j"’ s (t + e) — J"' s (t) = 0, hence 

+ £) - nli{t + £) - [7f’*(f) - nA,-f] = -nXi£. 

Hence, on LAT}"" 5 , 

sup sup \Jj' i (t)/n — Xjt\ +sup sup \j"’ s (t)/n — Xjt\ > A,-£. 
i 0<r<T+I * o<)<r 

By (12.51) . J n,s = E n — R"’ s , and therefore by the tightness of ||£' n || 7 ’ + i and 11A 1 "-' 11 7 - 1 , uniformly in s, 
we have that 

jy(t)-nXit 


sup sup 

s 0<t<T+l 


yfn 


are tight. Hence 


Next we show 


P(sup sup \jT‘' s (t) —1\ > e) — >• 0, as n — >• °o. 
s 0<t<T 


P(sup sup WT'' s (t) > 1) —>• 0, as n —>• 00 . 
i 0<*<r 


(5.4) 


(5.5) 


For every ft) in the event under consideration there exist t and s such that WI^’ s (t) > 1. Therefore, 
by (Hm 


(jT} ,s (t)) = )+ wT}’ s (t))— b"’ s (jT}’ s (t)) 

> B'!’ s (jr;-\t) + 1 )-B n i ' s {jr i '\t)), 

thus 

CFW(t)) > B n r s {JT’' S (t) + 1) - B’} ,s (jT]' s (t)) + %i\fn. 

The conclusion follows using (15.41) and the tightness of the r.v.s sup v \\Q n,s ||r+i and sup s \\B' ls \\t+2, 
n € N. 

Using (15.11) . the tightness of the r.v.s sup v || 2 "’ i || 7 ’+i and sup v |B"‘ s ’||r f 2 and the facts (15.41) and 
(15.51 ). gives that of sup v || WT ||r. As a result, WT US = e n,s . Using (15.11 ) again shows that ^(T) of 
(15.21 ) satisfies 

7i(T)< sup w T + 2 (B n ’ s , S) 

S 

on the event (sup v sup t<T (JI^’ s (t) + WT'f s {t )) < T + 2} D {sup ? WT]’ S < 5}. Since we have just 
argued that the probability of this event converges to 1 as n —>• °°, the result follows from (15.31) . □ 
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Finally we prove our main result. 

Proof of Theorem 12771 Let Q" be the event defined by (13.11) . Fix (/. j) £ 6. Then if 

C'ijitfji <J n,ij ) > C'/jia'/j, a" Jj ) + e , ( 5 . 6 ) 

we have by (12.201) . that AT}- < T. Now, there can be two cases. 

Case 1: h^r 1 g}’° (AT?—)) < r t . Then by (Il22ll . 4f(y) = 1, hence by (fT20l) . C'; j (o'} j .o nij ) = 
hiiWTj] ), whereas C ; "(a ; ",a'' 1 ' 7 ) = r t . Thus hi(WT { j ) > r ; - + £, and so 


hi(wflf) - e > r ; > h t 

Since is bounded by 0,- + 1, it follows that 

- n ,0 


A; 


I ^ + 4= > WTi’ 0 (Al”j) - n 
*“i h V' 1 


Q"'°(jT]’ S (AT}:)) 1 




A; 


~«,o Qr(AT} r ) 

= WT iJ - X J 


> inf{& — a : h(b) — h(a) > £, a £ [0,A ( . 1 (0,- + 1)],6 > 0} > 0, (5.7) 

by the continuity of /?. 

Case 2: h^r 1 Q'}’° (AT?—)) > r t . In this case, by (f2U2l) Af(;) = 0, by (lT20l) . 
and C?.(d£, <r"- y ) = h^wT")*). Hence h^WT-f) < n - £, and so 


= Ti 


hiiWTij) + £ < r, < hi 


QT°(AT}j~] 

A; 


As a result, 


A 


_ #(r) Qf(JT}’ s (AT}j)) l — n, S/rr1J , Q"' s (AT} r ) _ n , s 
y ^ - — - WT (A7?-) = \ J - WT U 

“ Ajt A; A,- 


> inf{6 — a : h(b) — h(a) > £, ft € [0, A,- 1 (0,• + 1)],a > 0} > 0, 

by the continuity and strict monotonicity of /?. 

Combining (15.71) and (15.8b shows that if (15.6b holds for some ( i,j) £ &, then 


(5.8) 


i^l>c> 0. 

k— 1 Ai- 


where c is a constant that does not depend on n. Using Proposition [5J] shows that P((f2") r ) —>• 0 
n —>• oo. This completes the proof. 


as 
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